Taobao MNN Team Open-Sources MNN-Pocket-0.3B; Offline Decoding on iPhone 18 Pro Surges to 350 tokens/s
The Taobao MNN team has open-sourced MNN-Pocket-0.3B, a lightweight large language model for mobile devices, with approximately 300 million parameters, specifically designed for mobile device resources and tasks. It delivers high-speed response and comprehensive capabilities comparable to the cloud with extremely low memory and energy consumption, and adopts an ultra-lightweight design that reduces its size by nearly half and keeps peak memory under 300MB, driving the deployment of large models on mobile phones.